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Abstract 

Aim. The purpose was to analyse the properties of two models for the assessment of return to work after sickness certification, a 
manual one based on clinical judgement including non-measurable information ('gut feeling'), and a computer-based one. 
Study population. All subjects aged 18 to 63 years, sickness-certified at a primary health care centre in Sweden during 8 months 
in = 943), and followed up for 3 years. 

Methods. Baseline information included age, sex, occupational status, sickness certification diagnosis, full-time or part-time 
current sick-leave, and sick-leave days during the past year. Follow-up information included first and last day of each occurring 
sick spell. In the manual model all subjects were classified, based on baseline information and gut feeling, into a high-risk 
(w = 447) or a low-risk group in = 496) regarding not returning to work when the present certificate expired. It was evaluated 
with a Cox's analysis, including time and return to work as dependent variables and risk group assignment as the independent 
variable, while in the computer-based model the baseline variables were entered as independent variables. 
Results. Concordance between actual return to work and return to work predicted by the analysis model was 73%-76% during 
the first 28-180 days in the manual model, and approximately 10% units higher in the computer-based model. Based on the 
latter, three nomograms were constructed providing detailed information on the probability of return to work. 
Conclusion. The computer-based model had a higher precision and gave more detailed information than the manual model. 
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Introduction 

Sickness absence is a major public health and eco- 
nomic problem in Sweden. In 2012, social insurance 
expenditures totalled approximately SEK 203 billion 
or 6% of GDP, of which more than half was used for 
people with an illness or disability (1). Almost 9% 
(504,000 people) of registered insured persons in the 
age range 16-64 years received sickness benefit at 
some point in 2012. Compensated sickness absence 
rates vary considerably over time. They more than 
doubled from the end of the 1990s to the beginning of 
the 2000s, of which long-term sick-leave spells 
(>59 days) explained the greater part. 



Long-term sickness absence usually starts with 
recurrent periods of short-term sick-leave that tend 
to increase in duration, interspersed with shorter and 
shorter non-sick-leave intervals (2). In 2002 long- 
term sick-leave constituted 30% of all sick-leave in 
women as well as in men, then declined during the 
following years to 15% in 2010, but then increased 
again in the last few years to around 20%. The 
variations in sickness absence over time are affected 
by change of compensation levels, adoption of a sick 
pay period, business cycle, and other factors (1). 

All residents in Sweden are covered by the National 
Social Insurance, which includes the right to see a 
physician of one's own choice, access to hospital care 
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at heavily subsidized rates, to have sickness benefit for 
income loss in case of reduced work capacity due to 
injury or disease, and a number of other items. The 
National Social Insurance is regulated by the Social 
Insurance Code (2010:110) and is managed by the 
National Social Insurance Agency (SIA), a govern- 
ment agent with offices in all municipalities across the 
country. 

In case of sick-leave, a patient's self-certification is 
accepted for an initial period of 7 days. After this 
period a sickness certificate form has to be completed 
by the patient's physician and sent to the patient's 
work-place. The employer is responsible for sick-leave 
pay during the first 14 days. If the sickness absence 
persists after this time, the sick-leave certificate is sent 
to the local SIA office, which then takes responsibility 
for sickness compensation and for further handling. 
For unemployed subjects SIA takes responsibility 
for sickness compensation from day 1. Otherwise, 
the same procedure as for employed subjects was 
followed (Social Insurance Code 2010:110). 

All physicians in Sweden are allowed to issue sick- 
ness certificates, but the role of sickness certification 
falls predominately on the general practitioners (GPs) 
(3), who regard sickness certification a common but 
problematic task (4-6). A study from Ireland con- 
cluded that GPs face many challenges and complex- 
ities in sickness certification in day-to-day practice 
and that these problems are similar to those in other 
European countries (7). One difficulty when issuing a 
sickness certificate is the assessment as to whether the 
patient will return to work (RTW) or not after a 
defined period of sick-leave, important because of 
the risk of long-term sick-leave. 

However, GPs' ability to predict RTW has been 
questioned. Reiso et al. found that physicians' pre- 
diction of RTW was highly accurate for short-term 
episodes but less so for more long-term ones (8). 
Fleten et al. found that sick-listed individuals pre- 
dicted their length of sick-leave more accurately than 
professionals did (9). 

A possible reason for these prediction difficulties 
may be the lack of assessment tools. In other research 
areas various instruments for the prediction of 
outcomes have been forwarded, of which the most 
common are so-called nomograms, where the com- 
bined effects of various levels of predictors for the risk 
of a specific outcome may be arrived at. Examples are 
the risk nomograms for myocardial infarction 
(10-12), the WHO Fracture Risk Prediction Tool 
(FRAX) for evaluation of the probability of a fracture 
(13), and the asthma risk nomogram to assess the risk 
in preschool children of developing asthma during the 
next 5 years (14). No similar instrument for the 
prediction of RTW has been presented so far. 



This report is based on a longitudinal study of 
RTW after sickness certification. The aim was to 
compare the predictive properties of a traditional 
GP clinical assessment of RTW, with those based 
on a multivariate analysis of potential determinants 
presented as nomograms for RTW. 

Methods 

Setting 

The study has been described in detail elsewhere (15). 
It was performed in the city of Eskilstuna, Sweden, an 
industrial city, located 110 kilometres west of Stock- 
holm, with 91,000 residents in 2004. The study was 
performed at one of the County Council-operated 
primary health care centres, with 10 GPs serving a 
population of approximately 25,000 residents. 

Study population 

The study was designed as a 3-year prospective cohort 
study with recruitment from 1 January until 3 1 August 
2004. During the recruitment period copies of all 
sickness certificates, whether new or prolongation 
ones, issued at the primary health care centre, were 
obtained. All individuals aged 18 to 63, who were 
sickness-certified by a physician at the centre at any 
time during the recruitment period, and who were not 
already included in a medical or vocational rehabil- 
itation programme, were included, altogether 943 
subjects (482 women and 461 men). 

Data collection 

Once a week all new sickness certificates were exam- 
ined by a team of experienced rehabilitation profes- 
sionals including a physiotherapist, a physician (first 
author), and a clerk from the local SIA office. The 
members of the team were the same during 
the 8-month inclusion period. From the sickness 
certificate information on age, sex, occupational sta- 
tus (in gainful work or not), sick-leave diagnosis 
(according to the WHO International Classification 
of Diseases (ICD-10)) (16), and degree of sick-leave 
(25%, 50%, 75%, or 100%) was obtained. Informa- 
tion on sickness absence during the year preceding the 
baseline examination and during the 3 years following 
baseline was obtained from the SIA national database, 
and included first and last day of each sickness spell, 
type of sickness benefit (compensation for sickness or 
rehabilitation), sick-leave diagnosis, whether a disabil- 
ity pension was granted during follow-up, information 
on marital status, income, whether born in Sweden, 
and for immigrants whether being a Swedish citizen. 
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Sick certification data were checked with the primary 
health care medical records in order to get valid 
information on the sick-leave during the first 
14 days (employer-paid sick-leave salary). 

Information on vital status was obtained from the 
National Cause of Death Register, providing date of 
death for those who died (n = 6). The study was 
approved by the Regional Ethical Review Board in 
Stockholm, Sweden. 

Statistical considerations 

Data were analysed with the SAS software, version 
9.3. There were no missing data. In Sweden people 
may earn a living in five ways: they may have a job with 
a salary, they may be on sickness benefit/disability 
pension, they may be on unemployment benefit, they 
may rely on municipality income support, or they may 
rely on the informal economy sector (student, artist, 
own capital, 'black market', etc.). RTW was therefore 
defined as conclusion of the sick certification in effect 
at baseline (even though the vast majority of subjects, 
78%, returned to work). The 3-year sick-leave follow- 
up data were converted into a day-by-day matrix 
starting with variable day 0 (baseline day) and ending 
with variable day 1095 (end of follow-up), each var- 
iable measuring whether the subject was on sick-leave 
(=1) or not (=0) on that day. 

Based on this matrix a RTW variable was com- 
puted. For each sick spell the following two RTW 
criteria were applied; 1) the sick spell was followed by 
a sick-leave-free interval of more than 28 days, regard- 
less of the length of any following sick spell, 2) the sick 
spell was followed by a sick-leave-free interval of more 
than 7 days, and that interval was longer than the next 
sick spell. When at least one of the criteria was 
satisfied, RTW was presumed to have occurred on 
the first non-sick-leave day. If none of the criteria were 
satisfied at end of follow-up no RTW presumably had 
occurred. Follow-up time from baseline to RTW or 
end of follow-up was measured as number of days 
from baseline. 

In this study the power of two RTW prediction 
models were compared. According to the manual 
model sick-listed subjects were classified into a 
high-risk or a low-risk group for not returning to 
work as expected at the time of sick certification, in 
a way similar to the GP assessment in everyday clinical 
practice. The classification was performed by the 
team (same members throughout the study) and 
based on sickness certification during the last year 
for more than 28 days, sickness certified at baseline 
because of musculoskeletal disease (ICD code M) or a 
psychiatric disease (F), being unemployed, being 
more than 45 years old, and being a woman. The 



three first factors were given a high weight, the fourth 
somewhat less weight, and the two last were valid only 
in borderline cases as reinforcement of risk. 

Typically, a woman aged 55, unemployed, and with 
sick-listing periods in the previous year for a diagnosis 
of fibromyalgia, would be categorized as high-risk, 
while a man, 37 years old, employed, and presently 
having a full sick-leave, might be categorized as low- 
risk. However, if this patient had many days of sick- 
leave last year with a diagnosis of stress, he might be 
classified as high-risk. Moreover, the classification 
contained an element of intuition ('gut feeling') as 
well, based on the assessor's experience. Altogether 
447 subjects were classified as having a high risk and 
496 as having a low risk regarding RTW at expected 
time. 

The manual model was analysed using proportional 
hazards regression (Cox's analysis), with RTW and 
the day from baseline when it occurred as dependent 
variables and high/low risk group assignment as the 
independent variable. 

The computer-based model was also based on the 
proportional hazards regression technique in its 
multivariate form. In a previous publication based 
on the same data set as used here, the significant 
determinants for RTW were age at baseline, number 
of days of sick-leave during the year preceding base- 
line, sick-leave diagnosis, degree of sick-leave, and 
occupational status (15). These determinants were 
used also in this study. RTW and the day from 
baseline when it occurred were entered as dependent 
variables, and the determinants mentioned above 
were entered as independent variables. The sick-leave 
diagnoses were grouped as ICD- 10 codes F and G 
(labelled -2 in the analysis), I, K, and M (labelled - 
1), A, B, O, and L (labelled +1), N (labelled +2), H 
and J (labelled +3), and all other diagnoses (labelled 
0). The labelling was based on Cox's analyses with 
outcome and diagnoses only. The diagnostic labels 
reflected the association with RTW, label -2 having 
the slowest and label +3 the fastest RTW. 

The proportionality assumption in both models was 
checked by the SAS 'Lifetest' procedure and found 
acceptable. During the analyses of model 2 there were 
signs of collinearity between occupational status, sick- 
leave diagnosis, and number of sick-leave days during 
the last year, all highly intercorrelated. After elimina- 
tion of the variable with the weakest association with 
outcome, occupational status, no signs of collinearity 
remained. 

From the Cox's analysis of the computer-based 
model, data were obtained showing proportion return- 
ing to work for combinations of age, number of sick- 
leave days last year, and sick-leave diagnosis groups on 
day 28, day 90, and day 1 80 from baseline (used by SIA 



A Return to work, days 0-28 



ICD-10 diagnosis code Sick leave 




B Return to work, days 0-90 



ICD-10 diagnosis code Sick leave 




C Return to work, days 0 - 1 80 



ICD-10 diagnosis code Sick leave 




Figure 1. Nomograms showing proportion (%) returning to work on day 28 (a), 90 (b), and day 180 (c) from baseline. Age is attained age at 
baseline, sick-leave days during the last year are the total number of days of sick-leave, and ICD-10 diagnostic codes are the ICD-10 chapter 
codes F = psychiatric disease, G = nervous system disease, I = cardiovascular disease, K = gastrointestinal disease, M = musculoskeletal disease, 
A = infectious disease, B = parasite disease, O = obstetric disorders, L = dermatology disease, N = genitourinary system diseases, H = eye or ear 
disease, J = respiratory disease. The return to work probability is obtained by drawing a line connecting the actual age and the number of sick- 
leave days last year. Where the line crosses the bold vertical line in the middle of the nomogram, the return to work probability (%) is found by 
moving horizontally to the sick-leave diagnosis group. For example, the proportion returning to work within the first 28 days in a 54-year-old 
subject with 73 sick-leave days last year and an F diagnosis is approximately 38%, and 78% if the diagnosis was J. The corresponding 
proportions at day 90 are approximately 56% and 92%, respectively. 



Men 

Mean (SD) or % 



39.2 (11.66) 

30-48 

77.2 
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Table I. Characteristics of the study population. 



women 



Mean (SD) or % 



Age, years 
Mean 

Interquartile range 
Employed, % 
Marital status, % 

Never married 

Married or cohabiting 

Divorced 

Widowed 
Sick-leave before baseline, days 

Mean 

Interquartile range 
Full-time sick-leave at baseline 
Sick-leave diagnoses (ICD-10), % 
Musculoskeletal disease (M) 
Psychiatric disease (F) 
Respiratory disease (J) 
Injury, poisoning (S, T) 
Symptoms and signs (R) 
Infectious-parasite disease (A, B) 
Dermatology disease (L) 
Cardiovascular disease (I) 
Genitourinary system disease (N) 
Digestive system disease (K) 
Eye or ear disease (H) 
Nervous system disease (G) 
Endocrine-metabolic disease (E) 
Blood disease (D) 
Pregnancy, childbirth (O) 
Miscellaneous 



482 

365 

195 
183 
90 
12 



431 

150 
131 

88 

17 

33 

12 

9 

8 

7 

5 

5 

5 

4 

3 

1 

4 



39.1 (12.04) 

29-49 

75.7 

40.5 
38.0 
18.7 
2.5 



161 

356 

218 
162 

79 

2 



as times for instituting rehabilitation). These data were 
entered in the nomograms in Figure 1 . 

Degree of explanation was measured as agreement 
between the real (crude) outcome and outcome 
according to the analysis models, with concordance 
c index derived from logistic regression. All tests were 
two-tailed, and the significance level was set atp < 0.05 . 

Results 

Characteristics of the study population 

Slightly more than half of the subjects were women, 
mean and median age were 39 years, more than 75% 



47.3 
35.1 
17.1 
0.4 



55.1 (105.82) 48.8 (94.69) 

0-49 0-37 

89.4 430 93.3 

31.1 152 33.0 

27.2 90 19.5 

18.3 70 15.2 
3.5 34 7.4 
6.9 31 6.7 
2.5 20 4.3 
1.9 9 2.0 
1.7 10 2.2 
1.5 8 1.7 
1.0 13 2.8 
1.0 6 1.3 
1.0 5 1.1 
0.8 3 0.7 
0.6 1 0.2 
0.2 0 

0.8 9 2.0 



were employed, more than 93% were Swedish citi- 
zens, 44% were never married and somewhat more 
than one-third were married, mean number of days of 
sick-leave during the year preceding baseline was 51, 
and the vast majority were on full-time sick-leave 
(Table I). The most common sickness certification 
diagnoses in rank order were musculoskeletal disease, 
psychiatric disease, and respiratory system disease. 

At baseline all subjects were on sick-leave. Among 
both men and women, 50% of the subjects had 
returned to work within 14 days, 75% of the men 
within 55 days, and 75% of the women within 80 days. 
At end of the follow-up, 6 (1.3%) men and 9 (1.9%) 
women were still on sick-leave. 
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Return to work according to the manual model 

As shown in Table II, those classified as being at high 
risk of not returning to work as expected were signif- 
icantly older, were women and unemployed to a larger 
extent, were on full-time sick-leave to a lesser extent, 
had more often more than 28 days of sick-leave last 
year, and had musculoskeletal or psychiatric diagno- 
ses to a larger extent than those at low risk. 

The hazard ratio of RTW in the high-risk group in 
relation to the low-risk group was 0.29 (0.24-0.34) 
after the first 28 days, 0.32 (0.28-0.38) during the first 
90 days, and 0.35 (0.30-0.40) during the first 
180 days of follow-up, indicating 71%, 68%, and 
65% less RTW during the three time periods in the 
high-risk group than in the low-risk group. The 
agreement between the real (crude) outcome and 
outcome according to the analysis model was 
76.0%, 74.0%, and 73.2% for the three time periods, 
respectively. 

Return to work according to the computer-based model 

The results are shown in Table III. During the first 
28, 90, and 180 days, increasing age, increasing 
number of sick-leave days last year, and being on 
full-time sick-leave decreased the probability for 
RTW. Moreover, there was a gradient among the 
sick-leave diagnoses with a progressively larger 
decrease of RTW probability with more 'heavy' diag- 
noses. According to Wald's chi-square, the most 
influential determinants during all the three time 



periods were number of sick-leave days last year 
and sick-leave diagnosis followed by age, while degree 
of sick-leave was of minor importance. The agreement 
between the real (crude) outcome and analysis model 
outcome was 86.1%, 88.0%, and 89.4%, approxi- 
mately 10% units higher than in the manual model. 

The proportion of the study population returning to 
work in relation to age at baseline, days of sick-leave, 
and sick-leave diagnosis is shown in Figure 1 . During 
the first 28 days RTW ranged from 10% among the 
oldest subjects with the most 'heavy' diagnoses (F and 
G), and a long track record of previous sick-leave, to 
98% among the youngest with the 'lightest' diagnoses 
(H and J) and no sick-leave during the last year. 

Figure 1 also shows RTW after 90 and 180 days. 
On day 90 from baseline the RTW ranged from 17% 
among the oldest with the most 'heavy' diagnoses (F 
and G), and a long track record of previous sick-leave, 
to 100% among the youngest with the lightest diag- 
noses (H and J) and no sick-leave during the last year. 
The corresponding range of proportions on day 1 80 
was 23% to 100%. 



Discussion 

The two RTW assessment models performed well, 
with a high agreement between actually occurring 
RTW and RTW according to the two analysis models, 
even though the computer-based one had a better 
precision (89% agreement) than the manual model 
(76%) and also provided more detailed information 



Table II. Characteristics of the risk 


groups 


and effects of the risk 


grouping on 


return to work. 










Low-risk group 






High-risk group 










HR 




Mean 


HR 


p for group 




n 


Mean (SD) or % 


(95% CI) 


n 


(SD) or % 


(95% CI) 


difference 


n 


496 


52.6 




447 


47.4 






Age, years 




38.2 (12.6) 






40.2 (10.9) 




< 0.005 


Women, % 


233 


47.0 




249 


55.7 




< 0.01 


Employed, % 


440 


88.7 




281 


62.9 




< 0.0001 


Full-time sick-leave, % 


481 


97.0 




380 


85.0 




< 0.0001 


Sick-leave >28 days last year, % 


68 


13.7 




210 


47.0 




< 0.0001 


Sick-leave diagnosis 
















Musculoskeletal disorder 


111 


22.4 




191 


42.7 




< 0.0001 


Psychiatric disorder 


59 


11.9 




162 


36.2 




< 0.0001 


Effect on return to work 
















Within 28 days 


435 


87.7 


1.00 - 


181 


40.5 


0.29 (0.24-0.34) 


< 0.0001 


Within 90 days 


466 


94.0 


1.00 - 


275 


61.5 


0.32 (0.28-0.38) 


< 0.0001 


Within 180 days 


479 


96.6 


1.00 - 


331 


74.1 


0.35 (0.30-0.40) 


< 0.0001 



Differences in characteristics were tested with Student's t test, and effect on return to work with proportional hazards regression. 
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Table III. Effects of possible determinants on return to work during three time periods. 



Return to work 





HR 


95% CI 


Wald's chi-square 


P 


Concordance c 
index 


First 28 days 










86.1 


Age, years 


0.987 


0.981-0.994 


13.0 


< 0.0005 




Sick-leave last year, days 


0.990 


0.987-0.992 


87.2 


< 0.0001 




Full-time sick-leave 


0.45 


0.29-0.68 


13.8 


< 0.0005 




Sick-leave diagnosis 












F or G -2 


0.35 


0.27-0.45 


66.6 


< 0.0001 




I, K, or M -1 


0.48 


0.38-0.60 


44.7 


< 0.0001 




All other diagnoses (0) 


0.59 


0.46-0.75 


17.2 


< 0.0001 




A, B, O, L (+1) 


0.69 


0.50-0.97 


4.7 


< 0.05 




N (+2) 


1.00 


0.56-1.81 


0 


0.99 




First 90 days 










88.0 


Age, years 


0.983 


0.977-0.989 


27.8 


< 0.0001 




Sick-leave last year, days 


0.992 


0.981-0.993 


128.3 


< 0.0001 




Full-time sick-leave 


0.59 


0.43-0.80 


11.3 


< 0.001 




Sick-leave diagnosis 












F or G -2 


0.35 


0.27-0.44 


81.2 


< 0.0001 




I, K, or M -1 


0.44 


0.35-0.54 


61.4 


< 0.0001 




All other diagnoses (0) 


0.53 


0.42-0.68 


26.1 


< 0.0001 




A, B, O, L (+1) 


0.67 


0.48-0.92 


6.0 


< 0.05 




N (+2) 


1.03 


0.58-1.82 


0 


0.92 




First 180 days 










89.4 


Age, years 


0.982 


0.976-0.988 


32.9 


< 0.0001 




Sick-leave last year, days 


0.993 


0.992-0.994 


153.6 


< 0.0001 




Full-time sick-leave 


0.73 


0.56-0.95 


5.4 


< 0.05 




Sick-leave diagnosis 












F or G -2 


0.33 


0.27-0.42 


91.9 


< 0.0001 




I, K, or M -1 


0.43 


0.35-0.53 


65.9 


< 0.0001 




All other diagnoses (0) 


0.52 


0.41-0.66 


28.9 


< 0.0001 




A, B, O, L (+1) 


0.67 


0.49-0.93 


5.8 


< 0.05 




N (+2) 


0.99 


0.56-1.74 


0 


0.96 





on the probability of RTW. Both models were stable 
over time, at least to day 1 80, when the vast majority 
of subjects had returned to work. 

The study population included all patients that 
were sickness-certified during a certain time period 
(time window), which means that the study popula- 
tion might be regarded as equivalent to a random 
sample. Moreover, the data on which the two models 
were based were obtained from official sources, such 
as sick-leave certificates, medical records, and the 
national SIA database. During the study period the 
Eskilstuna population had similar age and sex distri- 
bution and similar socio-economic characteristics as 



the national Swedish population (17). Moreover, the 
Swedish cities of Gothenburg, Uppsala, and Eskil- 
stuna followed the same track regarding proportion of 
the population being on sick-leave from 1986 and 
onwards (2). This means that the study population 
appears to be representative for a Swedish sickness- 
certified population, and the data on which RTW was 
based have high face validity. 

Regarding the relevance of the results for other 
countries than Sweden, it is well known from other 
research areas, for instance cardiovascular disease 
research, that the level of risk for an incident varies 
geographically (18), but the determinants, or risk 
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factors, for an incident are the same irrespective of 
geography (11,12). The situation appears to be the 
same for RTW after sickness certification. In Dutch, 
Danish, and British studies, sick-leave track record 
data have been shown to be a risk marker of future 
sickness absence and disability pension (19-21). The 
importance of sick-leave diagnosis in relation to delay 
of RTW is well studied (22-28), and so is the variation 
in prevalence of sickness certification (29). This 
means that nomograms like those in this report 
perhaps have to be revised regarding level (probability 
of RTW), but the main construct may be used 
internationally. 

The strengths of the study include the large study 
population, the complete data set, and the high pre- 
cision in the analyses. A possible limitation could be 
the choice of determinants for the analysis, since other 
variables might serve the same purpose. However, the 
degree of explanation in the regression-based model, 
close to 90%, means that the possibility that any 
overlooked strong determinant might alone provide 
10% explanation is unlikely. 

The models tested in this report were supposed to 
have different underlying properties, in spite of the 
fact that they basically relied on the same variables. 
The manual model was mimicking the way GPs assess 
risk of long-term sick-leave, based on presence or 
absence of known risk factors but also with intuitive 
elements. GPs often face complicated, vague pro- 
blems in situations of uncertainty, which have to be 
solved in a brief consultation. In these situations, 'gut 
feeling' has been shown to play a significant role in the 
diagnostic process, also described as a third track 
beside medical decision-making and medical 
problem-solving (30). Furthermore, gut feeling is a 
specific form of intuition based on the interaction 
between patient information and the GP's own 
knowledge and experience. In a qualitative Dutch 
GP study, two types of gut feeling were distinguished, 
a sense of reassurance, and a sense of alarm (31). The 
GPs explained the first as being confident about 
prognosis and therapy, although they might not 
have a clear diagnosis in mind. The latter was 
described as a feeling of something being wrong 
even though arguments for this circumstance were 
lacking. In another study the presence of gut feeling in 
diagnostic reasoning among GPs could be measurable 
with a validated questionnaire (32). In the manual 
model the intuitive element, the gut feeling of the 
highly experienced rehabilitation team, was similar to 
a sense of alarm in cases classified into the high-risk 
group ('something is wrong with the sick-listing 
course of this patient'). 

The computer-based model was based on the stan- 
dard method to construct nomograms. A priori, the 



manual model, being more flexible in its structure and 
perhaps catching important non-measurable informa- 
tion by its intuitive component, was assumed to 
perform at least as well or better than the com- 
puter-based model. However, the opposite turned 
out to be the case. 

In both models RTW was inversely related to age, 
number of sick-leave days during the last year, and 
being on full-time sick-leave, and increased across the 
diagnosis code groups from F and G to H and J. In the 
manual model female sex was used as a factor asso- 
ciated with a moderate delay in RTW. In the 
computer-based model sex did not affect RTW, since 
it was competed out by other factors. The manual 
model provides only a yes/no grading of increased risk 
of delayed RTW, while the computer-based model 
provided a graded probability of RTW, ranging from 
only a few per cent for those with the slowest RTW up 
to 100% for those with the fastest. 

The outcome in both models was the actually 
occurring RTW. The number of subjects returning 
to work according to the two models was the same as 
the actual RTW. The difference between the models 
refers to their precision in correctly identifying sub- 
jects that actually returned to work and those that did 
not. The proportion of correctly identified subjects 
returning or not returning to work was 73%-76% with 
the manual model, indicating that a quarter of the 
subjects were misclassified. In the computer-based 
model 86%-89% were correctly classified, the 
proportion misclassified thus being less than half 
compared to the manual method. 

The development of nomograms to predict RTW 
among sickness-certified patients is a novelty of this 
study. An implication for clinical practice of the 
findings in this study might be that the nomograms 
can be used not only by GPs when assessing their 
sickness-certified patients' time for RTW, but also for 
rehabilitation teams and stakeholders in vocational 
rehabilitation. Patients with high risk may be referred 
to a rehabilitation team for a deeper assessment of 
choice of therapy and whether vocational rehabilita- 
tion would enable the patient to regain work ability. In 
a third step, systematic rehabilitation in co-operation 
between employer, occupational health service, and 
the local SIA might be useful (33). 

Conclusions 

Both models performed well, with a high concordance 
between actually occurring RTW and RTW accord- 
ing to the analysis models. However, the computer- 
based model had a moderately higher precision and 
provided more detailed information on probability of 
RTW than the manual model. 
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